iCub3 avatar system: Enabling remote fully immersive embodiment of humanoid robots.

We present an avatar system designed to facilitate the embodiment of humanoid robots by human operators, validated through iCub3, a humanoid developed at the Istituto Italiano di Tecnologia. More precisely, the paper makes two contributions: First, we present the humanoid iCub3 as a robotic avatar that integrates the latest significant improvements after about 15 years of development of the iCub series. Second, we present a versatile avatar system enabling humans to embody humanoid robots encompassing aspects such as locomotion, manipulation, voice, and facial expressions with comprehensive sensory feedback including visual, auditory, haptic, weight, and touch modalities. We validated the system by implementing several avatar architecture instances, each tailored to specific requirements. First, we evaluated the optimized architecture for verbal, nonverbal, and physical interactions with a remote recipient. This testing involved the operator in Genoa and the avatar in the Biennale di Venezia, Venice-about 290 kilometers away-thus allowing the operator to visit the Italian art exhibition remotely. Second, we evaluated the optimized architecture for recipient physical collaboration and public engagement on stage, live, at the We Make Future show, a prominent world digital innovation festival. In this instance, the operator was situated in Genoa while the avatar operated in Rimini-about 300 kilometers away-interacting with a recipient who entrusted the avatar with a payload to carry on stage before an audience of approximately 2000 spectators. Third, we present the architecture implemented by the iCub Team for the All Nippon Airways (ANA) Avatar XPrize competition.

A Novel Sensorised Insole for Sensing Feet Pressure Distributions.

Wearable sensors are gaining in popularity because they enable outdoor experimental monitoring. This paper presents a cost-effective sensorised insole based on a mesh of tactile capacitive sensors. Each sensor's spatial resolution is about 4 taxels/cm 2 in order to have an accurate reconstruction of the contact pressure distribution. As a consequence, the insole provides information such as contact forces, moments, and centre of pressure. To retrieve this information, a calibration technique that fuses measurements from a vacuum chamber and shoes equipped with force/torque sensors is proposed. The validation analysis shows that the best performance achieved a root mean square error (RMSE) of about 7 N for the contact forces and 2 N m for the contact moments when using the force/torque shoe data as ground truth. Thus, the insole may be an alternative to force/torque sensors for certain applications, with a considerably more cost-effective and less invasive hardware.

Six-Axis Force Torque Sensor Model-Based In Situ Calibration Method and Its Impact in Floating-Based Robot Dynamic Performance.

A crucial part of dynamic motions is the interaction with other objects or the environment. Floating base robots have yet to perform these motions repeatably and reliably. Force torque sensors are able to provide the full description of a contact. Despite that, their use beyond a simple threshold logic is not widespread in floating base robots. Force torque sensors might change performance when mounted, which is why in situ calibration methods can improve the performance of robots by ensuring better force torque measurements. The Model-Based in situ calibration method with temperature compensation has shown promising results in improving FT sensor measurements. There are two main goals for this paper. The first is to facilitate the use and understanding of the method by providing guidelines that show their usefulness through experimental results. Then the impact of having better FT measurements with no temperature drift are demonstrated by proving that the offset estimated with this method is still useful days and even a month from the time of estimation. The effect of this is showcased by comparing the sensor response with different offsets simultaneously during real robot experiments. Furthermore, quantitative results of the improvement in dynamic behaviors due to the in situ calibration are shown. Finally, we show how using better FT measurements as feedback in low and high level controllers can impact the performance of floating base robots during dynamic motions. Experiments were performed on the floating base robot iCub.

Simultaneous Floating-Base Estimation of Human Kinematics and Joint Torques.

The paper presents a stochastic methodology for the simultaneous floating-base estimation of the human whole-body kinematics and dynamics (i.e., joint torques, internal and external forces). The paper builds upon our former work where a fixed-base formulation had been developed for the human estimation problem. The presented approach is validated by presenting experimental results of a health subject equipped with a wearable motion tracking system and a pair of shoes sensorized with force/torque sensors while performing different motion tasks, e.g., walking on a treadmill. The results show that joint torque estimates obtained by using floating-base and fixed-base approaches match satisfactorily, thus validating the present approach.

Whole-Body Human Inverse Dynamics with Distributed Micro-Accelerometers, Gyros and Force Sensing.

Human motion tracking is a powerful tool used in a large range of applications that require human movement analysis. Although it is a well-established technique, its main limitation is the lack of estimation of real-time kinetics information such as forces and torques during the motion capture. In this paper, we present a novel approach for a human soft wearable force tracking for the simultaneous estimation of whole-body forces along with the motion. The early stage of our framework encompasses traditional passive marker based methods, inertial and contact force sensor modalities and harnesses a probabilistic computational technique for estimating dynamic quantities, originally proposed in the domain of humanoid robot control. We present experimental analysis on subjects performing a two degrees-of-freedom bowing task, and we estimate the motion and kinetics quantities. The results demonstrate the validity of the proposed method. We discuss the possible use of this technique in the design of a novel soft wearable force tracking device and its potential applications.